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1 Introduction 



The objective of this paper is to explain the principles of the design of a 
coarse space in a simplified way and by pictures. The focus is on ideas rather 
than on a more historically complete presentation. That can be found, e.g., in 
Widlund [2008]. Also, space limitation does not allow us to even the mention 
many important methods and papers that should be rightfully included. 

The coarse space facilitates a global exchange of information in multigrid 
and domain decomposition methods for elliptic problems. This exchange is 
^ necessary, because the solution is non-local: its value at any point depends on 

'— 1 the right-hand-side at any other point. Both multigrid and domain decom- 

position combine a global correction in coarse space with local corrections, 
called smoothing in multigrid and subdomain solves in domain decomposi- 
l/") tion. In multigrid the coarse space is large (typically, the mesh ratio is 2 or 3 

CN at most) and the local solvers are not very powerful (usually, relaxation). In 

domain decomposition, the coarse space is small (just one or a few degrees of 
freedom per subdomain), and the local solvers are powerful (direct solvers on 
subdomain). But the mathematics is more or less the same. 



2 Local nullspace and bounded energy conditions 

Consider the variational problem 



c3 u e V : a(u, v) = f(v) Vw e V, (1) 

where a is symmetric positive definite and V is a finite dimensional space. 
Most, if not all, multigrid, domain decomposition, and substructuring methods 
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for (1) can be cast as variants of the additive Schwarz method (ASM), which 
is the preconditioning by the approximate solver 

N 

M : r ^ (2) 

i=0 

where Ui are solutions of the subproblems 

Ui £ Vi : a(v,i,Vi) = r(vi) Vui £ V* (3) 

where 

V = Vb + Vi + • • • + V N (4) 

The resulting condition number of the preconditioned problem is then bounded 
by nCo, where n < N+l is the maximal number of the subspaces Vo, V\, . . . , Vn 
that have nontrivial intersections, and Co is the constant from the bounded 
energy decomposition property 

N N 

Vw £ V3vi e Vi : v = ^Vi, y^a(vi,Vi) < C a(v,v) , (5) 

4=0 4=0 

cf., Widlund [1988], Bj0rstad and Mandel [1991], Dryja and Widlund [1995]. 

Variants of ASM include the multiplicative use of the subspace correction 
in Mandel [1993a, 1994], and the use of other forms in place of a in subprob- 
lems (3), cf., Dryja and Widlund [1995], Toselli and Widlund [2005]. 

Now consider V to be a space of functions on a domain fl. The subspaces 
Vi range from the span of one basis vector in multigrid (for the simplest 
case, Jacobi iteration) to spaces of functions on large overlapping subdomains 
J2j. When the domain Q is the union of non-overlapping subdomains Qj, 
j = 1,...,M, the spaces Vi are defined as certain subspaces of the space 
W = W\ x • • • x Wm, where Wj is a space of functions on Qj. The natural 
splitting of the bilinear form a (•, •) into integrals over fij is then a (u, v) = 

j n X7 u ' V v = Sj=i a j ( u ' w )j where the local bilinear forms 

aj (u,v) = x/u-xjv (6) 

are used on Wj instead of the bilinear form a (■,■). 

The space V is the coarse space, and the rest of this paper deals with its 
construction. It had been long understood and then formulated explicitly in 
Mandel [1990a] that for condition numbers to be independent of the number 
of subdomains, the coarse space needs to contain the nullspace of the local 
bilinear forms aj (•,•). For the scalar problem as in (6), this means constant 
functions, while for elasticity, the coarse space needs to contain the rigid body 
modes of every substructure. Much of the development of the coarse space in 
domain decomposition has been driven by the need for the coarse space to 
satisfy this local nullspace condition at the same time as the bounded energy 
condition a (vq, vq) < Cqo (v, v), required as a part of (5). 
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Fig. 1. Left: Piecewise bilinear coarse space function. Right: piecewise constant 
functions. 

3 Some early domain decomposition methods 

By taking vq in (5) first, we see that the design objective of the coarse space is 
that there should exist a mapping v G V i — > Vq G Vq such that (i) the energy 
of vo is not too large, and (ii) the remainder v — vq can be decomposed in the 
spaces Vi, i = 1, ...,N, without increasing the energy too much. Definition 
of vo by linear or bilinear interpolation is the natural first choice (Fig. 1 left). 
Because of the discrete Sobolev inequality, this works fine in 2D: values of v at 
interpolation nodes are bounded by the energy of v up to a logarithmic factor 
in the mesh size h. The remainder v — vq is tied to zero by its zero values at 
the interpolation nodes, and it turns out it can be decomposed into Uj's with 
bounded energy (up to a logarithmic factor). In 3D, however, the pointwise 
values of v for constant energy of v can grow quickly as h — > 0, so interpolation 
can no longer be used. Overlapping methods (Dryja and Widlund [1994]) use 
decomposition into Vi's by a partition of unity on overlapping subdomains J?$, 
and they carry over to 3D; only the interpolation from the values of v needs to 
be replaced by a method that is energy stable in 3D, such as interpolation from 
averages or L 2 projection. In some non-overlapping methods, however, the 
functions Vi are defined in such way that they are zero at the nodes that define 
the values of vo, e.g., Bramble et al. [1986]. Then a straightforward extension 
of the method to 3D forces vq to be linear interpolant from pointwise values of 
v. Bramble et al. [1989] resolved this problem by redefining the coarse bilinear 
form do so that do (it, u) = J2i=i mm c; J n \S7U - a\ ; cf., Mandel [1990b] for 
a generalization to elasticity and an algebraic explanation. The coarse space 
degrees of freedom are one number Ci per substructure, thus the coarse space 
can be thought of as piecewise constant (Fig. 1 right). Piecewise constant 
coarse space used with the original bilinear form a (•, •) results in aggregation 
methods (Vanek et al. [1996]). Dryja [1988] defined the interpolant by discrete 
harmonic functions, which have lower energy than piecewise linear functions. 
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Fig. 2. Left: BDD coarse basis function, with support on one substructure and 
adjacent ones. Right: Coarse function on one substructure of BDD for plates, and 
BDDC (reproduced from Mandel and Dohrmann [2003]). 

4 Balancing domain decomposition (BDD) and FETI 

The BDD method was created by Mandel [1993a] by adding a special coarse 
space to the Neumann-Neumann (NN) method from De Roeck and Le Tal- 
lec [1991]. The NN method uses the additive preconditioner with the local 
forms dj from (6) and no coarse space. In the NN method, the local forms are 
generally singular and the local problems (3) are not consistent. The BDD 
preconditioner applies multiplicatively a coarse correction based on a known 
superspace Zi of the local nullspace and designed so that the right-hand side 
in (3) is orthogonal to Z±. Since the nullspace of a, is contained in Zi, (3) 
is now guaranteed to be consistent. The coarse space is obtained by aver- 
aging between adjacent substructures and extending the functions from the 
substructure boundaries in the interior with minimal energy (i.e., as discrete 
harmonic). A basis function of the resulting coarse space is in Fig. 2 right. Of 
course, for elasticity, rigid body modes are used rather than constants, giving 
6 coarse degrees of freedom per substructure in 3D. 

BDD is completely algebraic. It can be implemented only by calls to sub- 
domain matrix-vector multiplication and by access to a basis of the local 
space Zi (such as the rigid body modes written in terms of the degrees of 
freedom). This made possible a black-box type application of BDD to mixed 
finite elements in Cowsar et al. [1995]: the substructure matrix- vector multi- 
ply becomes the mapping of pressure on substructure faces to the velocity in 
the normal direction. (Some components of other methods can be generated 
algebraically also; e.g., overlapping Schwarz methods are used as smoothers 
in adaptive algebraic multigrid in Poole et al. [2003].) 

BDD with the spaces Zi given by constants or rigid body modes is not 
suitable for 4th order problems (such as plate bending) , because the tearing at 
corners has high energy - the trace norm associated with 4th order problem is 
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the Sobolev norm H 3 ^ 2 . But empowering BDD by enriching the coarse space 
was envisioned already in Mandcl [1993a], and all that was needed was to 
enlarge the spaces Zi so that after the coarse correction, the error is zero at 
corners, thus the tears across the corners do not matter. In Le Tallec et al. 
[1998], such Zi consists of functions determined by their values at the corners 
of the substructure, and by having minimal energy (Fig. 2 right). 

The FETI method by Farhat and Roux [1991] runs in the dual space of 
Lagrange multipliers and it uses a coarse space constructed from the exact 
nullspace of the local problems (3). In the scalar case, this is the space of 
discontinuous piecewise constant functions (Fig. 1 right), and of piecewise 
rigid body modes for elasticity. Since the dual space (after elimination of the 
interior) is equipped with the ff -1 / 2 norm, jumps between subdomains do not 
cause a large energy increase. Like BDD, FETI is completely algebraic, which 
is why the two methods have become popular in practice. Mandel et al. [1999] 
generalized FETI to deal with 4th order problems analogously as in BDD, 
but the resulting method, called FETI-2, was quite complicated. Since the 
basic algebra of FETI relics on the exact nullspace of the local problems, the 
added coarse functions had to be in a new coarse space of their own, with the 
additional components of the coarse correction wrapped around the original 
FETI method. Eventually FETI-2 was superseded by FETI-DP. 

A Neumann-Neumann method, also called balancing but somewhat dif- 
ferent from BDD, was developed in Dryja and Widlund [1995]. This method 
uses the same coarse space as BDD, but additively, and it takes care of the 
singularity in the local problems by adding small numbers to the diagonal. To 
guarantee optimal condition bounds, a modification of the form ao is needed. 
This method is not algebraic in the same sense as BDD or FETI, i.e., relying 
on the matrices only. 

5 BDDC and FETI-DP 

A satisfactory extension of FETI and BDD to 4th order problems came only 
with FETI-DP by Farhat et al. [2000] and BDDC by Dohrmann [2003]. These 
methods are based on identical components and have the same spectrum, 
except possibly for the eigenvalues equal to zero and one (Mandel et al. [2005]), 
so we can discuss BDDC only. The coarse space consists of functions given 
by their values of coarse degrees of freedom and energy minimal on every 
substructure independently. For coarse degrees of freedom given by values on 
substructure corners, this is the same coarse space as in BDD for plates in 
Le Tallec et al. [1998] (Fig. 2 right, Fig. 3 right), and the substructure spaces 
Wi are also the same. The new feature of BDDC is that the coarse correction is 
additive, not multiplicative, resulting in a sparser coarse matrix (Mandel and 
Dohrmann [2003]). In 3D, FETI-DP and BDDC require additional degrees of 
freedom for optimal convergence, namely averages on faces or edges (Farhat 
et al. [2000], Klawonn et al. [2002]), cf., Fig. 3 left for a visualization in 2D. 
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Fig. 3. Left: coarse function in BDDC for edge average degree of freedom on one 
substructure. Right: BDD for plates and BDDC coarse space with vertex degrees of 
freedom on several substructures (courtesy of Marta Certfkova and Jakub Sfstek) . 
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Fig. 4. Intelligent iterative method. Adapted from Mandel [1993b]. 



6 Adaptive methods by enriching the coarse space 



Enlarging the coarse space is a powerful but expensive tool. When the coarse 
space is the whole space, domain decomposition turns into a direct solver. So, 
adding suitable functions to the coarse space adaptively can yield a robust 
method, which is fast on easy problems, but does not fail on hard ones (Fig. 4). 
In Mandel [1996], the coarse space in the p- version finite element method con- 
sists of linear functions when all is good, quadratic functions when things get 
worse, all function in one direction in the case of strong anisotropy, up to all 
functions when the heuristic gives up. In Poole et al. [2003], a similar method- 
ology was applied in algebraic multigrid. In Mandel and Sousedi'k [2007] and 
in the companion paper Sousedi'k and Mandel [2010] in this volume, the coarse 
space in BDDC is enriched by adaptively selected linear combinations of basis 
functions on substructure faces. 
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